Unsupervised decoding of long-term, naturalistic human neural recordings with automated video and audio annotations

Fully automated decoding of human activities and intentions from direct neural recordings is a tantalizing challenge in brain-computer interfacing. Most ongoing efforts have focused on training decoders on specific, stereotyped tasks in laboratory settings. Implementing brain-computer interfaces (BCIs) in natural settings requires adaptive strategies and scalable algorithms that require minimal supervision. Here we propose an unsupervised approach to decoding neural states from human brain recordings acquired in a naturalistic context. We demonstrate our approach on continuous long-term electrocorticographic (ECoG) data recorded over many days from the brain surface of subjects in a hospital room, with simultaneous audio and video recordings. We first discovered clusters in high-dimensional ECoG recordings and then annotated coherent clusters using speech and movement labels extracted automatically from audio and video recordings. To our knowledge, this represents the first time techniques from computer vision and speech processing have been used for natural ECoG decoding. Our results show that our unsupervised approach can discover distinct behaviors from ECoG data, including moving, speaking and resting. We verify the accuracy of our approach by comparing to manual annotations. Projecting the discovered cluster centers back onto the brain, this technique opens the door to automated functional brain mapping in natural settings

Comparison of Patient- and Practitioner-Reported Toxic Effects Associated With Chemoradiotherapy for Head and Neck Cancer

Agreement between patient- and practitioner-reported toxic effects during chemoradiotherapy for head and neck cancer is unknown. To compare patient-reported symptom severity and practitioner-reported toxic effects among patients receiving chemoradiotherapy for head and neck cancer. Forty-four patients participating in a phase 2 trial of deintensified chemoradiotherapy for oropharyngeal carcinoma were included in the present study (conducted from February 8, 2012, to March 2, 2015). Most treatment (radiotherapy, 60 Gy, with concurrent weekly administration of cisplatin, 30 mg/m2) was administered at academic medical centers. Included patients had no prior head and neck cancers, were 18 years or older, and had a smoking history of 10 pack-years or less or more than 10 pack-years but 30 pack-years or less and abstinent for the past 5 years. Cancer status was untreated human papillomavirus or p16-positive squamous cell carcinoma of the oropharynx or unknown head and neck primary site; and cancer staging was category T0 to T3, category N0 to N2c, M0, and Eastern Cooperative Oncology Group performance status 0 to 1. Baseline, weekly, and posttreatment toxic effects were assessed by physicians or nurse practitioners using National Cancer Institute's Common Terminology Criteria for Adverse Events (CTCAE), version 4.0. Patient-reported symptom severity was measured using the Patient-Reported Outcomes version of the CTCAE (PRO-CTCAE). Descriptive statistics were used to characterize raw agreement between CTCAE grades and PRO-CTCAE severity ratings. Baseline, weekly, and posttreatment toxic effects assessed using CTCAE, version 4.0, and PRO-CTCAE. Raw agreement indices between patient-reported toxic effects, including symptom frequency, severity, and interference with daily activities (score range, 0 [none] to 4 [very severe]), and practitioner-measured toxic effects, including swallowing, oral pain, and hoarseness (score range, 1 [mild] to 5 [death]). Of the 44 patients included in the analysis (39 men, 5 women; mean [SD] age, 61 [8.4] years), there were 327 analyzable pairs of CTCAE and PRO-CTCAE symptom surveys and no treatment delays due to toxic effects. Patient-reported and practitioner-reported symptom severity agreement was high at baseline when most symptoms were absent but declined throughout treatment as toxic effects increased. Most disagreement was due to lower severity of toxic effects reported by practitioners (eg, from 45% agreement at baseline to 27% at the final week of treatment for pain). This was particularly noted for domains that are not easily evaluated by physical examination, such as anxiety and fatigue (eg, severity of fatigue decreased from 43% at baseline to 12% in the final week of treatment). Practitioner-reported toxic effects are lower than patient self-reports during head and neck chemoradiotherapy. The inclusion of patient-reported symptomatic toxic effects provides information that can potentially enhance clinical management and improve data quality in clinical trials

Use of mobile device technology to continuously collect patient-reported symptoms during radiation therapy for head and neck cancer: A prospective feasibility study

AbstractPurposeAccurate assessment of toxicity allows for timely delivery of supportive measures during radiation therapy for head and neck cancer. The current paradigm requires weekly evaluation of patients by a provider. The purpose of this study is to evaluate the feasibility of monitoring patient reported symptoms via mobile devices.Methods and materialsWe developed a mobile application for patients to report symptoms in 5 domains using validated questions. Patients were asked to report symptoms using a mobile device once daily during treatment or more often as needed. Clinicians reviewed patient-reported symptoms during weekly symptom management visits and patients completed surveys regarding perceptions of the utility of the mobile application. The primary outcome measure was patient compliance with mobile device reporting. Compliance is defined as number of days with a symptom report divided by number of days on study.ResultsThere were 921 symptom reports collected from 22 patients during treatment. Median reporting compliance was 71% (interquartile range, 45%-80%). Median number of reports submitted per patient was 34 (interquartile range, 21-53). Median number of reports submitted by patients per week was similar throughout radiation therapy and there was significant reporting during nonclinic hours. Patients reported high satisfaction with the use of mobile devices to report symptoms.ConclusionsA substantial percentage of patients used mobile devices to continuously report symptoms throughout a course of radiation therapy for head and neck cancer. Future studies should evaluate the impact of mobile device symptom reporting on improving patient outcomes

Control of intestinal stem cell function and proliferation by mitochondrial pyruvate metabolism.

Most differentiated cells convert glucose to pyruvate in the cytosol through glycolysis, followed by pyruvate oxidation in the mitochondria. These processes are linked by the mitochondrial pyruvate carrier (MPC), which is required for efficient mitochondrial pyruvate uptake. In contrast, proliferative cells, including many cancer and stem cells, perform glycolysis robustly but limit fractional mitochondrial pyruvate oxidation. We sought to understand the role this transition from glycolysis to pyruvate oxidation plays in stem cell maintenance and differentiation. Loss of the MPC in Lgr5-EGFP-positive stem cells, or treatment of intestinal organoids with an MPC inhibitor, increases proliferation and expands the stem cell compartment. Similarly, genetic deletion of the MPC in Drosophila intestinal stem cells also increases proliferation, whereas MPC overexpression suppresses stem cell proliferation. These data demonstrate that limiting mitochondrial pyruvate metabolism is necessary and sufficient to maintain the proliferation of intestinal stem cells

Canvass: a crowd-sourced, natural-product screening library for exploring biological space

NCATS thanks Dingyin Tao for assistance with compound characterization. This research was supported by the Intramural Research Program of the National Center for Advancing Translational Sciences, National Institutes of Health (NIH). R.B.A. acknowledges support from NSF (CHE-1665145) and NIH (GM126221). M.K.B. acknowledges support from NIH (5R01GM110131). N.Z.B. thanks support from NIGMS, NIH (R01GM114061). J.K.C. acknowledges support from NSF (CHE-1665331). J.C. acknowledges support from the Fogarty International Center, NIH (TW009872). P.A.C. acknowledges support from the National Cancer Institute (NCI), NIH (R01 CA158275), and the NIH/National Institute of Aging (P01 AG012411). N.K.G. acknowledges support from NSF (CHE-1464898). B.C.G. thanks the support of NSF (RUI: 213569), the Camille and Henry Dreyfus Foundation, and the Arnold and Mabel Beckman Foundation. C.C.H. thanks the start-up funds from the Scripps Institution of Oceanography for support. J.N.J. acknowledges support from NIH (GM 063557, GM 084333). A.D.K. thanks the support from NCI, NIH (P01CA125066). D.G.I.K. acknowledges support from the National Center for Complementary and Integrative Health (1 R01 AT008088) and the Fogarty International Center, NIH (U01 TW00313), and gratefully acknowledges courtesies extended by the Government of Madagascar (Ministere des Eaux et Forets). O.K. thanks NIH (R01GM071779) for financial support. T.J.M. acknowledges support from NIH (GM116952). S.M. acknowledges support from NIH (DA045884-01, DA046487-01, AA026949-01), the Office of the Assistant Secretary of Defense for Health Affairs through the Peer Reviewed Medical Research Program (W81XWH-17-1-0256), and NCI, NIH, through a Cancer Center Support Grant (P30 CA008748). K.N.M. thanks the California Department of Food and Agriculture Pierce's Disease and Glassy Winged Sharpshooter Board for support. B.T.M. thanks Michael Mullowney for his contribution in the isolation, elucidation, and submission of the compounds in this work. P.N. acknowledges support from NIH (R01 GM111476). L.E.O. acknowledges support from NIH (R01-HL25854, R01-GM30859, R0-1-NS-12389). L.E.B., J.K.S., and J.A.P. thank the NIH (R35 GM-118173, R24 GM-111625) for research support. F.R. thanks the American Lebanese Syrian Associated Charities (ALSAC) for financial support. I.S. thanks the University of Oklahoma Startup funds for support. J.T.S. acknowledges support from ACS PRF (53767-ND1) and NSF (CHE-1414298), and thanks Drs. Kellan N. Lamb and Michael J. Di Maso for their synthetic contribution. B.S. acknowledges support from NIH (CA78747, CA106150, GM114353, GM115575). W.S. acknowledges support from NIGMS, NIH (R15GM116032, P30 GM103450), and thanks the University of Arkansas for startup funds and the Arkansas Biosciences Institute (ABI) for seed money. C.R.J.S. acknowledges support from NIH (R01GM121656). D.S.T. thanks the support of NIH (T32 CA062948-Gudas) and PhRMA Foundation to A.L.V., NIH (P41 GM076267) to D.S.T., and CCSG NIH (P30 CA008748) to C.B. Thompson. R.E.T. acknowledges support from NIGMS, NIH (GM129465). R.J.T. thanks the American Cancer Society (RSG-12-253-01-CDD) and NSF (CHE1361173) for support. D.A.V. thanks the Camille and Henry Dreyfus Foundation, the National Science Foundation (CHE-0353662, CHE-1005253, and CHE-1725142), the Beckman Foundation, the Sherman Fairchild Foundation, the John Stauffer Charitable Trust, and the Christian Scholars Foundation for support. J.W. acknowledges support from the American Cancer Society through the Research Scholar Grant (RSG-13-011-01-CDD). W.M.W.acknowledges support from NIGMS, NIH (GM119426), and NSF (CHE1755698). A.Z. acknowledges support from NSF (CHE-1463819). (Intramural Research Program of the National Center for Advancing Translational Sciences, National Institutes of Health (NIH); CHE-1665145 - NSF; CHE-1665331 - NSF; CHE-1464898 - NSF; RUI: 213569 - NSF; CHE-1414298 - NSF; CHE1361173 - NSF; CHE1755698 - NSF; CHE-1463819 - NSF; GM126221 - NIH; 5R01GM110131 - NIH; GM 063557 - NIH; GM 084333 - NIH; R01GM071779 - NIH; GM116952 - NIH; DA045884-01 - NIH; DA046487-01 - NIH; AA026949-01 - NIH; R01 GM111476 - NIH; R01-HL25854 - NIH; R01-GM30859 - NIH; R0-1-NS-12389 - NIH; R35 GM-118173 - NIH; R24 GM-111625 - NIH; CA78747 - NIH; CA106150 - NIH; GM114353 - NIH; GM115575 - NIH; R01GM121656 - NIH; T32 CA062948-Gudas - NIH; P41 GM076267 - NIH; R01GM114061 - NIGMS, NIH; R15GM116032 - NIGMS, NIH; P30 GM103450 - NIGMS, NIH; GM129465 - NIGMS, NIH; GM119426 - NIGMS, NIH; TW009872 - Fogarty International Center, NIH; U01 TW00313 - Fogarty International Center, NIH; R01 CA158275 - National Cancer Institute (NCI), NIH; P01 AG012411 - NIH/National Institute of Aging; Camille and Henry Dreyfus Foundation; Arnold and Mabel Beckman Foundation; Scripps Institution of Oceanography; P01CA125066 - NCI, NIH; 1 R01 AT008088 - National Center for Complementary and Integrative Health; W81XWH-17-1-0256 - Office of the Assistant Secretary of Defense for Health Affairs through the Peer Reviewed Medical Research Program; P30 CA008748 - NCI, NIH, through a Cancer Center Support Grant; California Department of Food and Agriculture Pierce's Disease and Glassy Winged Sharpshooter Board; American Lebanese Syrian Associated Charities (ALSAC); University of Oklahoma Startup funds; 53767-ND1 - ACS PRF; PhRMA Foundation; P30 CA008748 - CCSG NIH; RSG-12-253-01-CDD - American Cancer Society; RSG-13-011-01-CDD - American Cancer Society; CHE-0353662 - National Science Foundation; CHE-1005253 - National Science Foundation; CHE-1725142 - National Science Foundation; Beckman Foundation; Sherman Fairchild Foundation; John Stauffer Charitable Trust; Christian Scholars Foundation)Published versionSupporting documentatio

Body size and digestive system shape resource selection by ungulates : a cross-taxa test of the forage maturation hypothesis

The forage maturation hypothesis (FMH) states that energy intake for ungulates is maximised when forage biomass is at intermediate levels. Nevertheless, metabolic allometry and different digestive systems suggest that resource selection should vary across ungulate species. By combining GPS relocations with remotely sensed data on forage characteristics and surface water, we quantified the effect of body size and digestive system in determining movements of 30 populations of hindgut fermenters (equids) and ruminants across biomes. Selection for intermediate forage biomass was negatively related to body size, regardless of digestive system. Selection for proximity to surface water was stronger for equids relative to ruminants, regardless of body size. To be more generalisable, we suggest that the FMH explicitly incorporate contingencies in body size and digestive system, with small-bodied ruminants selecting more strongly for potential energy intake, and hindgut fermenters selecting more strongly for surface water.DATA AVAILABILITY STATEMENT : The dataset used in our analyses is available via Dryad repository (https://doi.org/10.5061/dryad.jsxksn09f) following a year-long embargo from publication of the manuscript. The coordinates associated with mountain zebra data are not provided in an effort to protect critically endangered black rhino (Diceros bicornis) locations. Interested researchers can contact the data owner (Minnesota Zoo) directly for inquiries.https://wileyonlinelibrary.com/journal/elehj2022Mammal Research InstituteZoology and Entomolog

Mortality and pulmonary complications in patients undergoing surgery with perioperative SARS-CoV-2 infection: an international cohort study

Background: The impact of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) on postoperative recovery needs to be understood to inform clinical decision making during and after the COVID-19 pandemic. This study reports 30-day mortality and pulmonary complication rates in patients with perioperative SARS-CoV-2 infection. Methods: This international, multicentre, cohort study at 235 hospitals in 24 countries included all patients undergoing surgery who had SARS-CoV-2 infection confirmed within 7 days before or 30 days after surgery. The primary outcome measure was 30-day postoperative mortality and was assessed in all enrolled patients. The main secondary outcome measure was pulmonary complications, defined as pneumonia, acute respiratory distress syndrome, or unexpected postoperative ventilation. Findings: This analysis includes 1128 patients who had surgery between Jan 1 and March 31, 2020, of whom 835 (74·0%) had emergency surgery and 280 (24·8%) had elective surgery. SARS-CoV-2 infection was confirmed preoperatively in 294 (26·1%) patients. 30-day mortality was 23·8% (268 of 1128). Pulmonary complications occurred in 577 (51·2%) of 1128 patients; 30-day mortality in these patients was 38·0% (219 of 577), accounting for 81·7% (219 of 268) of all deaths. In adjusted analyses, 30-day mortality was associated with male sex (odds ratio 1·75 [95% CI 1·28–2·40], p\textless0·0001), age 70 years or older versus younger than 70 years (2·30 [1·65–3·22], p\textless0·0001), American Society of Anesthesiologists grades 3–5 versus grades 1–2 (2·35 [1·57–3·53], p\textless0·0001), malignant versus benign or obstetric diagnosis (1·55 [1·01–2·39], p=0·046), emergency versus elective surgery (1·67 [1·06–2·63], p=0·026), and major versus minor surgery (1·52 [1·01–2·31], p=0·047). Interpretation: Postoperative pulmonary complications occur in half of patients with perioperative SARS-CoV-2 infection and are associated with high mortality. Thresholds for surgery during the COVID-19 pandemic should be higher than during normal practice, particularly in men aged 70 years and older. Consideration should be given for postponing non-urgent procedures and promoting non-operative treatment to delay or avoid the need for surgery. Funding: National Institute for Health Research (NIHR), Association of Coloproctology of Great Britain and Ireland, Bowel and Cancer Research, Bowel Disease Research Foundation, Association of Upper Gastrointestinal Surgeons, British Association of Surgical Oncology, British Gynaecological Cancer Society, European Society of Coloproctology, NIHR Academy, Sarcoma UK, Vascular Society for Great Britain and Ireland, and Yorkshire Cancer Research

Behavioral responses of terrestrial mammals to COVID-19 lockdowns

DATA AND MATERIALS AVAILABILITY : The full dataset used in the final analyses (33) and associated code (34) are available at Dryad. A subset of the spatial coordinate datasets is available at Zenodo (35). Certain datasets of spatial coordinates will be available only through requests made to the authors due to conservation and Indigenous sovereignty concerns (see table S1 for more information on data use restrictions and contact information for data requests). These sensitive data will be made available upon request to qualified researchers for research purposes, provided that the data use will not threaten the study populations, such as by distribution or publication of the coordinates or detailed maps. Some datasets, such as those overseen by government agencies, have additional legal restrictions on data sharing, and researchers may need to formally apply for data access. Collaborations with data holders are generally encouraged, and in cases where data are held by Indigenous groups or institutions from regions that are under-represented in the global science community, collaboration may be required to ensure inclusion.COVID-19 lockdowns in early 2020 reduced human mobility, providing an opportunity to disentangle its effects on animals from those of landscape modifications. Using GPS data, we compared movements and road avoidance of 2300 terrestrial mammals (43 species) during the lockdowns to the same period in 2019. Individual responses were variable with no change in average movements or road avoidance behavior, likely due to variable lockdown conditions. However, under strict lockdowns 10-day 95th percentile displacements increased by 73%, suggesting increased landscape permeability. Animals’ 1-hour 95th percentile displacements declined by 12% and animals were 36% closer to roads in areas of high human footprint, indicating reduced avoidance during lockdowns. Overall, lockdowns rapidly altered some spatial behaviors, highlighting variable but substantial impacts of human mobility on wildlife worldwide.The Radboud Excellence Initiative, the German Federal Ministry of Education and Research, the National Science Foundation, Serbian Ministry of Education, Science and Technological Development, Dutch Research Council NWO program “Advanced Instrumentation for Wildlife Protection”, Fondation Segré, RZSS, IPE, Greensboro Science Center, Houston Zoo, Jacksonville Zoo and Gardens, Nashville Zoo, Naples Zoo, Reid Park Zoo, Miller Park, WWF, ZCOG, Zoo Miami, Zoo Miami Foundation, Beauval Nature, Greenville Zoo, Riverbanks zoo and garden, SAC Zoo, La Passarelle Conservation, Parc Animalier d’Auvergne, Disney Conservation Fund, Fresno Chaffee zoo, Play for nature, North Florida Wildlife Center, Abilene Zoo, a Liber Ero Fellowship, the Fish and Wildlife Compensation Program, Habitat Conservation Trust Foundation, Teck Coal, and the Grand Teton Association. The collection of Norwegian moose data was funded by the Norwegian Environment Agency, the German Ministry of Education and Research via the SPACES II project ORYCS, the Wyoming Game and Fish Department, Wyoming Game and Fish Commission, Bureau of Land Management, Muley Fanatic Foundation (including Southwest, Kemmerer, Upper Green, and Blue Ridge Chapters), Boone and Crockett Club, Wyoming Wildlife and Natural Resources Trust, Knobloch Family Foundation, Wyoming Animal Damage Management Board, Wyoming Governor’s Big Game License Coalition, Bowhunters of Wyoming, Wyoming Outfitters and Guides Association, Pope and Young Club, US Forest Service, US Fish and Wildlife Service, the Rocky Mountain Elk Foundation, Wyoming Wild Sheep Foundation, Wild Sheep Foundation, Wyoming Wildlife/Livestock Disease Research Partnership, the US National Science Foundation [IOS-1656642 and IOS-1656527, the Spanish Ministry of Economy, Industry and Competitiveness, and by a GRUPIN research grant from the Regional Government of Asturias, Sigrid Rausing Trust, Batubay Özkan, Barbara Watkins, NSERC Discovery Grant, the Federal Aid in Wildlife Restoration act under Pittman-Robertson project, the State University of New York, College of Environmental Science and Forestry, the Ministry of Education, Youth and Sport of the Czech Republic, the Ministry of Agriculture of the Czech Republic, Rufford Foundation, an American Society of Mammalogists African Graduate Student Research Fund, the German Science Foundation, the Israeli Science Foundation, the BSF-NSF, the Ministry of Agriculture, Forestry and Food and Slovenian Research Agency (CRP V1-1626), the Aage V. Jensen Naturfond (project: Kronvildt - viden, værdier og værktøjer), the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy, National Centre for Research and Development in Poland, the Slovenian Research Agency, the David Shepherd Wildlife Foundation, Disney Conservation Fund, Whitley Fund for Nature, Acton Family Giving, Zoo Basel, Columbus, Bioparc de Doué-la-Fontaine, Zoo Dresden, Zoo Idaho, Kolmården Zoo, Korkeasaari Zoo, La Passarelle, Zoo New England, Tierpark Berlin, Tulsa Zoo, the Ministry of Environment and Tourism, Government of Mongolia, the Mongolian Academy of Sciences, the Federal Aid in Wildlife Restoration act and the Illinois Department of Natural Resources, the National Science Foundation, Parks Canada, Natural Sciences and Engineering Research Council, Alberta Environment and Parks, Rocky Mountain Elk Foundation, Safari Club International and Alberta Conservation Association, the Consejo Nacional de Ciencias y Tecnología (CONACYT) of Paraguay, the Norwegian Environment Agency and the Swedish Environmental Protection Agency, EU funded Interreg SI-HR 410 Carnivora Dinarica project, Paklenica and Plitvice Lakes National Parks, UK Wolf Conservation Trust, EURONATUR and Bernd Thies Foundation, the Messerli Foundation in Switzerland and WWF Germany, the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie Actions, NASA Ecological Forecasting Program, the Ecotone Telemetry company, the French National Research Agency, LANDTHIRST, grant REPOS awarded by the i-Site MUSE thanks to the “Investissements d’avenir” program, the ANR Mov-It project, the USDA Hatch Act Formula Funding, the Fondation Segre and North American and European Zoos listed at http://www.giantanteater.org/, the Utah Division of Wildlife Resources, the Yellowstone Forever and the National Park Service, Missouri Department of Conservation, Federal Aid in Wildlife Restoration Grant, and State University of New York, various donors to the Botswana Predator Conservation Program, data from collared caribou in the Northwest Territories were made available through funds from the Department of Environment and Natural Resources, Government of the Northwest Territories. The European Research Council Horizon2020, the British Ecological Society, the Paul Jones Family Trust, and the Lord Kelvin Adam Smith fund, the Tanzania Wildlife Research Institute and Tanzania National Parks. The Eastern Shoshone and Northern Arapahoe Fish and Game Department and the Wyoming State Veterinary Laboratory, the Alaska Department of Fish and Game, Kodiak Brown Bear Trust, Rocky Mountain Elk Foundation, Koniag Native Corporation, Old Harbor Native Corporation, Afognak Native Corporation, Ouzinkie Native Corporation, Natives of Kodiak Native Corporation and the State University of New York, College of Environmental Science and Forestry, and the Slovenia Hunters Association and Slovenia Forest Service. F.C. was partly supported by the Resident Visiting Researcher Fellowship, IMéRA/Aix-Marseille Université, Marseille. This work was partially funded by the Center of Advanced Systems Understanding (CASUS), which is financed by Germany’s Federal Ministry of Education and Research (BMBF) and by the Saxon Ministry for Science, Culture and Tourism (SMWK) with tax funds on the basis of the budget approved by the Saxon State Parliament. This article is a contribution of the COVID-19 Bio-Logging Initiative, which is funded in part by the Gordon and Betty Moore Foundation (GBMF9881) and the National Geographic Society.https://www.science.org/journal/sciencehj2023Mammal Research InstituteZoology and Entomolog